ETS) 


) 


Research Memorandum 
ETS RM—20-09 


Teachers’ Perceptions of ProEthica® 
Program Learning Outcomes 


Heather M. Buzick 
Elizabeth A. Stone 
G. Tanner Jackson 


December 2020 / 


ETS Research Memorandum Series 


EIGNOR EXECUTIVE EDITOR 


John Mazzeo 
Distinguished Presidential Appointee 


ASSOCIATE EDITORS 


Beata Beigman Klebanov Anastassia Loukina 

Senior Research Scientist Managing Senior Research Scientist 
Heather Buzick Gautam Puhan 

Senior Research Scientist Psychometric Director 

Tim Davey Jonathan Schmidgall 

Research Director Research Scientist 

John Davis Jesse Sparks 

Research Scientist Research Scientist 

Marna Golub-Smith Michael Walker 

Principal Psychometrician Distinguished Presidential Appointee 
Priya Kannan Klaus Zechner 

Research Scientist Senior Research Scientist 

Sooyeon Kim Rebecca Zwick 

Principal Psychometrician Distinguished Presidential Appointee 


PRODUCTION EDITORS 


Kim Fryer Ayleen Gontz 
Manager, Editing Services Senior Editor 


Since its 1947 founding, ETS has conducted and disseminated scientific research to support its products and 
services, and to advance the measurement and education fields. In keeping with these goals, ETS is committed to 
making its research freely available to the professional community and to the general public. Published accounts 
of ETS research, including papers in the ETS Research Memorandum series, undergo a formal peer-review process 
by ETS staff to ensure that they meet established scientific and professional standards. All such ETS-conducted 
peer reviews are in addition to any reviews that outside organizations may provide as part of their own publication 
processes. Peer review notwithstanding, the positions expressed in the ETS Research Memorandum series and 
other published accounts of ETS research are those of the authors and not necessarily those of the Officers and 
Trustees of Educational Testing Service. 


The Daniel Eignor Editorship is named in honor of Dr. Daniel R. Eignor, who from 2001 until 2011 served the 
Research and Development division as Editor for the ETS Research Report series. The Eignor Editorship has been 
created to recognize the pivotal leadership role that Dr. Eignor played in the research publication process at ETS. 


Teachers’ Perceptions of ProEthica® Program Learning Outcomes 


Heather M. Buzick, Elizabeth A. Stone, and G. Tanner Jackson 


Educational Testing Service, Princeton, New Jersey, United States 


December 2020 


Corresponding author: H. Buzick, E-mail: hbuzick@ets.org 


Suggested citation: Buzick, H. M., Stone, E. A., & Jackson, G. T. (2020). Teachers’ perceptions of ProEthica® program 
learning outcomes (Research Memorandum No. RM-20-09). Educational Testing Service. 


Find other ETS-published reports by searching the ETS RESEARCHER 


database at https://search.ets.org/researcher/ 


To obtain a copy of an ETS research report, please visit 


https://ets.org/research/contact/ 


Action Editor: Jesse Sparks 


Reviewers: Rick Tannenbaum and Caroline Wylie 


Copyright © 2020 by Educational Testing Service. All rights reserved. 
ETS, the ETS logo, and PROETHICA are registered trademarks of Educational Testing Service (ETS). 


All other trademarks are the property of their respective owners. 


Abstract 
Ethics education can provide an opportunity to educators to learn how to fulfill their 
professional responsibilities with regard to ethics, including making decisions that protect 
students’ welfare. The ProEthica® program is a professional development program for teachers 
and administrators. The basic intended intermediate outcomes of the ProEthica program for 
teachers are that teachers will learn how to balance competing obligations and expectations in 
their relationships with students, colleagues, administrators, and the community and that they 
will gain knowledge about best practices and principles embodied in the Model Code of 
Educator Ethics. The purpose of this study was to collect initial evidence about the intended 
intermediate outcomes. Three surveys were developed and administered to teachers in a pilot 
school district before they began the ProEthica program, after they completed the program, 
and at the end of the program year. The study methodology and summaries of survey 
responses are documented in this report. 
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Professionalism in education includes the expectation that teachers possess knowledge, 
skills, and abilities to engage in practices and make decisions that protect students’ welfare. 
Sykes and Wilson (2015) described teaching as an “ethical practice that requires teachers to 
manage dilemmas of various kinds and to act in ways that support students’ best interests, 
sometimes in the face of countervailing pressures” (pp. 17-18). The professional 
responsibilities of teachers further include ethical commitments to students’ family members, 
other teachers, administrators, and service providers in their work supporting students’ 
learning and development (Sykes & Wilson, 2015, p. 77). 

States and other licensing agencies require that individuals who desire to enter and 
remain in the teaching profession acquire competencies that are necessary for safe and 
responsible practice and grow those competencies to deliver effective teaching. Opportunities 
to learn and develop new knowledge, skills, and abilities are provided through teacher 
education programs and in-service professional development. Ethics education is intended to 
provide an opportunity for educators to develop or refine some of those competencies and can 
be delivered to prospective and practicing teachers. 

The ProEthica® program for teachers is an online, self-paced professional development 
program that provides current and prospective teachers an opportunity to apply professional 
ethics in scenarios they might face in their practice.t Seven modules cover topics such as 
boundaries with students, appropriate relationships with members of the school community, 
appropriate use of technology, and applications of ethical decision-making. The modules are 
self-paced, and each was designed to be completed in less than 30 min. The program 
could take as little as 3.5 hr to complete or as much as many months. At the time of this study, 
the intended audience was novice teachers; subsequently, the audience 
had expanded to preservice teacher candidates. Hutchings et al. (2018) documented the 
alignment between ProEthica and the Model Code of Ethics for Educators (MCEE) sponsored 
by the National Association of State Directors of Teacher Education and Certification 
(NASDTEC, n.d.). 

The intended outcomes for teachers who complete the ProEthica program can be 


thought of as both short-term claims that focus on immediate learning for teachers and long- 
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term claims for what should happen when educators engage in this kind of work over the 


course of their careers. Our interpretation of the theory of action for ProEthica, which contains 


the program components that were available for teachers at the time of this study, the 


hypothesized action mechanisms, and the intended intermediate and ultimate outcomes, is 


shown in a logic model (refer to Figure 1). 


Figure 1. Logic Model Summarizing the ProEthica for Teachers Theory of Action 


Program 
Components 


e Seven self-paced, 
online learning 


simulations and 
activities based on 
real-life scenarios. 
End-of-module 
assessments. 
Summative 
assessment. 


Note. MCEE = Model Code of Ethics for Educators. 


modules with videos, 


Hypothesized Action 


Mechanisms 


Teachers engage 
with the material in 
the modules. 
Teachers complete 
the modules. 
Teachers 
collaboratively 
discuss routine and 
difficult professional 
ethics issues. 


Intended Intermediate 


Outcomes 


e Teachers learn how 
to better balance the 
often-competing 
obligations and 
expectations in their 
relationships with 
students, the school 
and the community. 
Teachers have a 
better understanding 


of general 
obligations under the 
law, relevant 
regulations and best 
practices. 


Teachers have an 
increased awareness 
of the principles 
embodied in the 
MCEE. 


Intended Ultimate 


Outcomes 


e Teachers develop a 


common 
understanding of 
professional ethics. 
Teachers make 
decisions that 
minimize risks and 
protect students. 
Teachers, in their 
interactions with 
students, the school, 
and the community, 
cultivate an ethical 
school culture. 
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The purpose of this study was to collect initial evidence about whether teachers who 
completed the modules perceived that they experienced the intended intermediate outcomes 


of the ProEthica program. 


Background 

State and district leaders aim to recruit and retain teachers who can deliver quality 
teaching with the capability to make decisions that minimize student risk. They are also 
interested in providing opportunities for educators to acquire knowledge, skills, and abilities 
that will help them fulfill their ethical responsibilities. These interests are represented by codes 
and standards that provide a common understanding of what it means to fulfill ethical 
responsibilities in education. Examples include the National Education Association’s Code of 
Ethics,* specific state codes (e.g., Davenport et al., 2015), and the MCEE (NASDTEC, n.d.). 


Regarding the MCEE, the mission statement describes the purpose for the code: 


The purpose of the Model Code of Ethics for Educators (MCEE) is to serve as a 
shared ethical guide for future and current educators faced with the 
complexities of P-12 education. The code establishes principles for ethical best 
practice, mindfulness, self-reflection and decision-making, setting the 
groundwork for self-regulation and self-accountability. The establishment of this 
professional code of ethics by educators for educators honors the public trust 


and upholds the dignity of the profession. (NASDTEC, 2015, p. 1) 


Winston (2007) motivated the need for ethics education by summarizing research 
suggesting that “individuals overestimate their ability to make ethical decisions and 
underestimate the impact of their biases on their decision making, particularly in organizational 
contexts and managerial decision making” (p. 235). Recognizing this need, some preparation 
programs include it in their curriculum (e.g., Strike, 1990), but according to the most recent 
review we found, Warnick and Silverman (2011), there have not been many documented ethics 
education programs in the field of education. This may have changed more recently; we are 


aware that at least some states require ethics education for teacher licensure at the preservice 
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or in-service level (refer to, e.g., the state licensing agency websites for Florida, Georgia, and 
Texas). 

Researchers describe the need for not only knowledge and understanding but also 
judgment in order for teachers to carry out their ethical responsibilities (e.g., Sykes & Wilson, 
2015). Warnick and Silverman (2011) suggested that “ethical theory, codes of ethics and case 
analysis together are important curricular components providing teachers the opportunity to 


learn and practice” (p. 275). Maxwell and Schwimmer (2016) posited that 


ethics education enhances quality teaching because: (1) familiarity with the 
collective norms of the profession and their practical application is conducive, if 
not essential, to professionalism; (2) reflecting on the ethical dimensions of 
teaching increases teachers’ sensitivity to the ethical issues that arise in 
professional practice; and (3) grappling with ethical problems intellectually 
promotes students’ cognitive moral judgment development, making them more 
likely to find the most rationally defensible solutions to the ethical dilemmas 


encountered at work. (p. 366) 


Note that this definition of quality teaching does not explicitly include student learning of 
content-specific knowledge and skills. Likewise, our interpretation of the ProEthica theory of 
action does not include a direct or measurable link to content-specific student learning. 
Evaluating professional development and curricular components is important to 
optimizing their effectiveness. In a meta-analysis of ethics education, Winston (2007) found 
that most evaluations of ethics education studies they reviewed used surveys to capture a 
snapshot of program effects. The studies were from other professions outside of education for 
the most part, with very few in education. We did not find any more recently published 
syntheses of research on ethics education within or outside of the education field. Winston 


(2007) described the studies included in the meta-analysis as follows: 


The most commonly represented was that of measuring perceptions or changes 
in perceptions based on the application of some treatment, such as course 
content. ... The measurement of perceptions included considerations such as 


respondents’ representations of how they would behave in a given circumstance 
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and faculty surveys regarding whether ethics should be taught and whether they 
teach it in their courses or departments. A far smaller percentage (16.7%) 
represented measures of reasoning or cognitive development or changes in 
such... . One-third of the studies were based on the analysis of more than one 
measure, such as combinations of measures of perception (how would you 
behave?) and measures of professional behavior (how do you behave?). (pp. 


242-243) 


Method 

Given time and budget constraints, including a lack of opportunity to recruit a control 
group, we chose for the evaluation study design a single-group pretest—posttest design where 
we targeted the population of teachers in a pilot district who were intended to be recipients of 
the treatment (i.e., the ProEthica program). A team of researchers, subject matter experts, and 
psychometricians developed three surveys to capture program completers’ perceptions of the 
intended intermediate outcomes of the program. 

We assumed that participants would differ in their baseline levels of exposure to ethical 
codes and issues related to educator ethics. Survey 1 (Pretest) was intended to capture baseline 
information about individuals’ existing knowledge and perceptions related to educator ethics, 
ethical decision-making in education contexts, and ethical codes. Some questions were adapted 
from an exit survey about experiences with a performance-based assessment about decision- 
making in the context of digital literacy (Katz, 2007). The survey was intended to be brief. Prior 
to administering Survey 1, five former teachers who were also researchers reviewed the items 
and provided feedback on their clarity and presentation. 

After an orientation session about ProEthica for school administrators, a district staff 
member distributed the online survey link to the 18 schools participating in the ProEthica pilot 
to share with teachers. Teachers in the pilot program district received a link to Survey 1 prior to 
being exposed to the program. The survey, open from mid-August to October of 2017, was 
optional. Respondents were eligible to be entered into a lottery for a $25 gift card. The survey 


included items on grades taught and years of experience, perceptions of teachers’ experiences 
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as an educator, prior knowledge and experience with ethics training, and personal experiences 
and perceptions relevant to the topics that would be covered in the ProEthica program. 

Survey 2 (Posttest A) was administered in the ProEthica learning management system 
after individuals completed all ProEthica modules, but participation was still optional. It 
launched in September 2017, near the beginning of the program year. It included several 
research items, which we created by revising, adapting, and expanding items from Survey 1 
based on how they functioned in that initial survey. The items included knowledge of and 
opinions about professional ethics principles, as well as perceptions regarding the learning and 
growth in thoughtfulness about professional decisions and their consequences that the 
teachers attributed to ProEthica. We included two questions about how seriously participants 
took the program that were worded in opposite directions to help detect acquiescence bias 
(e.g., selecting all positive responses without regard to the prompt content?). The survey also 
included items on usability and participants’ opinions about the functionality of the modules 
(not reported herein). 

Although we expected a good response rate from Survey 2 because it was delivered 
within the online program, we were not able to include all of our research survey items because 
of time constraints meant to minimize undue burden on ProEthica participants. We also wanted 
to give participants time to reflect on their experience with ProEthica. Consequently, we 
developed a second posttest, Survey 3, that was administered outside of the learning 
management system. The pilot district teachers received a link to participate in Survey 3 
(Posttest B) via email at the end of the program year (May 2018). Survey 3 included items 
regarding teachers’ progress with the ProEthica program, how long they spent on the modules, 
how long ago they completed the modules, their most recent experiences with educator ethics, 
personal experiences with and perceptions of educator ethics (not necessarily attributed to 
ProEthica), learning attributed to ProEthica, change in personal experiences and perceptions 
attributed to ProEthica, and knowledge of educator ethics. We used email addresses to create 
unique and anonymized participant identifiers to link Surveys 1, 2, and 3. 

We hypothesized that ProEthica would increase teachers’ awareness of and knowledge, 


skills, and abilities regarding their ethical responsibilities in the short term but expected that 
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individuals might overestimate their knowledge and abilities prior to participating (Winston, 
2007, p. 235). We expected this could manifest as perceptions of learning outcomes from 
ProEthica that underestimated participants’ actual learning. Further, our study design did not 
allow for us to rule out regression to the mean, a statistical artifact, as a plausible explanation 
for changes in perceptions over time. The surveys were also a source of measurement error 
because individuals’ perceptions are subjective measures of actual learning (Lavrakas, 2008) 
and because of the likelihood of response bias. These two main anticipated threats to the 
validity of inferences we might have drawn from results of causal statistical models—regression 
to the mean and possible measurement error resulting from subjective judgment and response 
bias—precluded us from isolating the impact of the ProEthica program on the intended 
outcomes. Consequently, in this report we document the study design and summarize the 
survey responses, providing preliminary evidence about the hypothesized intermediate 


outcomes in our interpretation of the ProEthica theory of action. 


Sample 

The total numbers of respondents to Surveys 1, 2, and 3 were 235, 564, and 432, 
respectively. Refer to Figure 2 for a visual representation of the numbers and percentages of 
participants in each subset of surveys and how they overlapped. Few teachers took all three 


surveys. 
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Figure 2. Numbers of Teachers Responding to Surveys 1, 2, and 3; Their Intersections; and 
Percentages of the Combined Sample 


Survey 1 
(n = 235) 


59 
(7.4%) 


61 46 
(7.65%) (5.77%) 


69 
(8.66%) 


245 128 


(30.74%) 189 (16.06%) 
(23.71%) 


Survey 2 Survey 3 
(n = 564) (n = 432) 


We estimated the response rates for each of the three surveys as follows. For Surveys 1 
and 3, we used the number of teachers who were enrolled in the program between August 
2017 and May 2018 as the denominator (n = 1,098). For Survey 2, we used the number of 
teachers in the pilot district who completed the ProEthica program between September 2017, 
when the survey commenced in the learning management system, and June 2018 (n = 804). The 


response rates were 21%, 70%, and 39% for Surveys 1, 2, and 3, respectively. 


Results 
We begin by describing the responses regarding teachers’ perceptions of their prior 
knowledge of educator ethics and ethics frameworks. Related prompts were administered on 
Surveys 1 and 2. The responses from Survey 1, which was administered prior to the program, 


are shown in Figure 3. Although 10%—20% of respondents had not heard of nor received 
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training on professional ethics for educator or state codes of conduct, most respondents 
reported at least some knowledge of or familiarity with professional ethics for educators. 

We asked respondents to Survey 2 (Posttest A) to reflect on the knowledge of 
professional ethics for educators that they had prior to completing the ProEthica program. 
Most respondents retrospectively reported at least some prior knowledge of or familiarity with 
professional ethics. There were nominal differences in responses between those who also 
completed Survey 1 and those who did not. We did not perform a statistical test of the 
differences in responses from the sample subsets because the sample was not drawn randomly 


from the population (refer to Figure 4). 


Figure 3. Participants’ Perceived Knowledge of Professional Ethics for Educators and the 


States’ Code of Ethics Prior to Participating in ProEthica (Survey 1) 


1.00 


0.75 


0.50 


Percentage of responses 


0.25 


| have not heard | have been introduced | am familiar | am an expert. 
about nor received __ to and have partial with them. 
training onthem. knowledge of them. 


0.00 


iit Professional ethics for educators an State code of ethics 
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Figure 4. Retrospective Perceptions About Knowledge of Professional Ethics for Educators 
Prior to Participating in ProEthica (Survey 2) for Individuals Who Did and Did Not Complete 


Survey 1 


1.004 


0.75 


0.25 
—— .-—rc OP 
0.004 


Percentage of responses 
os 
Oo 


| had no prior | had some | was familiar | was already 
knowledge of professional knowledge of professional with professional an expert in professional 
ethics for educators. ethics for educators. ethics for educators. ethics for educators. 


& Completed survey 1 i] Did not complete survey 1 


Note. Participants responded to the question, How would you describe your knowledge of 


professional ethics for educators before completing the ProEthica program? 


We asked the Survey 2 participants how they would rate the importance of the 
professional ethics principles as a framework to use in their educational practice since 
completing the ProEthica program. Most responded positively, with 93% indicating that they 
thought it was important or very important. 

We measured participants’ perceptions of their ProEthica learning experience through 
prompts about whether their understanding of the principles of professional ethics for 
educators had increased, whether they thought that the program caused them to think 
differently about managing risks while interacting with people in their school or community, 
whether they now felt more comfortable talking with their colleagues about professional 


ethics, and whether they now felt that more time should be devoted to discussing important 
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issues related to educator ethics in their school or community. We also measured whether they 
perceived that participation in the ProEthica program led participants to be more thoughtful 
about their actions with students, the consequences of their decisions regarding student— 
teacher relationships, how they interact with colleagues, and their choices when using social 
media and digital technology (Figure 5). Few responded negatively. These percentages were 
similar for the subset of respondents who had also responded to Survey 1 (not shown for 
brevity) with the exception that in that subset no strong disagreement was reported for any of 
these prompts and disagreement was reported only for the prompt regarding thoughtfulness 
about interactions with colleagues (2%). That is, nominally, Survey 1 respondents submitted 


fewer negative responses on Survey 2 than did Survey 1 nonrespondents. 


Figure 5. Survey 2 Responses on Participants’ Perceptions of Changes After Participating in 


ProEthica 


Strongly Agree < ~ ---> Strongly Disagree 


| am more thoughtful about 
my choices when using social media 
and digital technology 


| am more thoughtful about 
potential consequences of my decisions 
regarding student-teacher relationships. 


After completing the modules, 
| have a better understanding of the 
principles of professional ethics for educators. 


| am more thoughtful about 
my actions with students. 


| am more thoughtful about 
how | interact with colleagues. 


The ProEthica program has caused 
me to think differently about managing 
risks while interacting with 

people in my school community. 


| feel more comfortable 
talking with my colleagues 
about professional ethics. 


| feel that more time should 

be devoted to discussing important 
issues related to educator ethics 
within my school community. 


0.00 0.25 0.50 0.75 1.00 
B Strongly Agree Somewhat Agree Somewhat Disagree fo Strongly Disagree 
[E] Agree Neither Agree nor Disagree & Disagree 
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We focus now on Survey 3 (Posttest B; refer to Figure 6), which, recall, was distributed 
to district teachers via email at the end of the program year (May 2018). Teachers in the 
ProEthica pilot district were able to engage with the ProEthica module at their own pace; as 
such, we expected variation in whether Survey 3 participants had completed all the modules at 


the time they received the survey. 


Figure 6. How Long Since Survey 3 Respondents Completed the ProEthica Program 


1.00 


0.75 


Percentage of responses 


0.50 
; 7 
Within the About 1-4 About 1-3 About 3-6 More than 6 
past week weeks ago months ago months ago months ago 
Note. N = 427. 
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Most of the respondents (96%) had completed all the modules by the time they took 
the survey. All respondents who indicated that they had completed at least five of the seven 
modules were further asked how long it had taken to complete those modules and how long 
ago they had finished doing so. A priori, we did not have an expectation about how long 
teachers would take to complete the modules, except for bounding the survey question at a 
minimum of within 1-2 weeks and a maximum of within 1 year. Although the responses varied, 
of the 427 respondents, the most common response was finishing within 6 months of starting 
(46%). The length of time between completing the program and responding to Survey 3 varied 
as well, and a time since completion of about 1-3 months was the most common response 
(49%). 

We asked Survey 3 respondents to share their recent experiences with educator ethics. 
The experiences reported from highest to lowest frequency were having discussed the 
ProEthica materials with colleagues or friends (72%), engaging in casual discussions about a 
potential professional ethical issue (49%), engaging in formal discussions about issues related to 
educator ethics (11%), engaging in other relevant activities not listed in the question (7%), and 
engaging in activities to learn more about educator ethics outside the ProEthica program (6%). 
All Survey 3 respondents reported at least one recent experience, with the most frequent 
combination being that of the two most frequent single activities: discussing ProEthica with 
colleagues and friends and also engaging in casual discussions about a potential professional 
ethical issue (22%). No other combination of activities was reported by more than 5% of the 


respondents. 
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We asked participants about their personal experience and perceptions as a 
professional educator. Their responses are shown in Figure 7. Of particular note is that 
respondents tended to agree that professional ethics guidelines and training are important, and 
almost all respondents felt that they were fully aware of ethical issues facing their daily 
professional decisions. Meanwhile, fewer respondents saw a need for an improvement of 
school culture as it relates to ethical decision-making or viewed ProEthica as contributing to an 
improved school culture. Note that cultivating an ethical school culture is an ultimate outcome 
in our logic model (Figure 1), one that we would expect to occur over a longer time period than 


the duration of our study. 
Figure 7. Survey Participants’ Personal Experience and Perceptions as a Professional Educator 


Strongly Agree <----------------------------~-~~----------- nnn nanan nanan nnn nnn nnn nnn nnnnennnnnnnnnnnnn> Strongly Disagree 


| think it is important 

to have a set of professional 
ethics guidelines to inform 
professional decision-making. 


| think that professional 
ethics should be included 
as part of formal training. 


| feel that | am fully 

aware of the ethical issues 
affecting my daily 
professional decisions. 


| think that formal 

training in educator ethics 
should be required for 
employment in a school. 


| think that my school 
community needs to improve 
its culture and awareness 

of issues that involve 

ethical decision-making. 


| think that participating 
in the ProEthica Program will 
contribute to improvement in 
the culture at my school. 


ia Strongly Agree Somewhat Agree Somewhat Disagree B Strongly Disagree 
E] Agree Neither Agree nor Disagree E] Disagree 


Note. n = 432. 
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The two questions related to the importance of professional ethical guidelines and 
training (top of Figure 7) also appeared in Survey 1. Responses to both surveys from individuals 
who took both are shown in Figure 8. These responses represent 27% of the individuals who 
responded to Survey 3. There appeared to be some differences in responses between the two 
surveys among those who completed both surveys. Although 48 teachers did not change their 
minds about the importance of the guidelines, 17 got more negative, and 36 became more 
positive (refer to the left side of Figure 8). Similarly, there was a mix of different and similar 
responses between surveys about the role of professional ethics in formal training (refer to the 
right side of Figure 8). Thirty-nine teachers responded similarly on Survey 1 and Survey 3, while 


34 became more negative and 28 became more positive. 


Figure 8. Responses From Survey 1 and Survey 3 About the Importance of Professional Ethical 


Guidelines and Training 


| think it is important to have a set of professional | think that professional ethics should 
ethics guidelines to inform professional decision-making (n = 115). be included as part of formal training (n = 115) 
Strongly J 2) 3) i 30 4) 4 been!) | 10 
gree 
Agree - 3 EE et fe et che 1 (eat 19 (8 

> Somewhat _ 
eS Agree ie 1 9 y 2 
2 
a 
= Neither Agree _ 
© Nor Disagree ve 3S Y % 
> 
o 
2 
Ss Somewhat _ 7 2 
n Disagree . 

Disagree - f D 2 

Strongly _ } 

Disagree 4 2 \ 2 

Strongly Disagree Somewhat Neither Agree Somewhat Agree Strongly Strongly Disagree Somewhat Neither Agree Somewhat Agree Strongly 
Disagree Disagree Nor Disagree Agree Agree Disagree Disagree Nor Disagree Agree Agree 


Survey 1 (Percent) 


We asked Survey 3 respondents about their perceptions of acquiring knowledge of 
educator ethics via ProEthica. Their responses are summarized in Figures 9 and 10. Between 
two thirds and three quarters of respondents indicated at least some agreement, with at least 
70% indicating some level of agreement with prompts connected to the intermediate outcomes 
in the logic model (Figure 1). Similar percentages were found for prompts shown in Figure 10 
that were centered on thinking about the MCEE in interactions with students, awareness of 


previously overlooked ethical issues, confidence in being able to imagine outcomes of ethical 
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scenarios, and certainty about when to act or let something go in various ethical scenarios. 
However, prompts involving taking particular actions had lower levels of agreement. This may 
be expected, as these prompts are not directly related to intended intermediate outcomes in 


the logic model. 


Figure 9. Survey 3 Respondents’ Self-Reported Knowledge, Awareness, and Related Actions 


From ProEthica 


The ProEthica training program 
has helped me to... 


Strongly Agree <----------------------------------------------~-n nanan manne mann n nnn nnn nnn naan nnn nnn nnn nnn nnn nanan > Strongly Disagree 


Uphold my obligation to 
act in the public's interest 


Increase my awareness 
of professional risks 
and vulnerabilities. 


Foster a sense of responsibility 
to hold myself and others to 
professional ethics standards. 


Make decisions grounded 
in professional ethics 
standards. 


Increase my knowledge 
of professional ethics 
for educators. 


Build and communicate a 
shared understanding of 
professional ethics standards. 


Collaborate to discuss 
professional ethics within 
a supportive school climate. 


2 


0.00 0.25 0.50 0.75 0 
aI Strongly Agree Somewhat Agree Somewhat Disagree pe Strongly Disagree 
fiz Agree Neither Agree nor Disagree 4 Disagree 


Note. n= 432. 
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Figure 10. Survey 3 Participants’ Perceptions Since Participating in the ProEthica Program 


Strongly Agree <------------------------------------------- nanan nnn nnn nanan nnn nanan nnn nnn > Strongly Disagree 


| am more thoughtful about my 
choices when using 
social media and digital technology. 


| think more about the Model 
Code of Ethics for Educators (MCEE) 
when interacting with students. 


| feel that | am more aware of 
potential ethical related issues 
that | may have overlooked before. 


| feel that participating 
in the ProEthica training 
was worth the effort. 


| have more confidence in my 
ability to imagine various outcomes 
to an ethical scenario. 


| feel more certain of when to ‘act’ 
versus when to ‘let something go' when 
confronted with a potential ethical scenario. 


| am better about making 
the best decision with the 
least amount of risk. 


| feel more comfortable talking with my 
administrators about issues that 
involve my own ethical decision-making. 


| feel more comfortable talking with my 
colleagues about issues that involve 
my own ethical decision-making. 


| feel more comfortable talking to my 
colleagues about issues that involve 
their ethical decision-making. 


| feel more comfortable talking with my 
administrators about issues that involve 
my colleagues’ ethical decision-making. 


| think more about the Model 
Code of Ethics for Educators (MCEE) 
when interacting with my colleagues. 


0.00 0.25 0.50 0.75 1.00 
& Strongly Agree Somewhat Agree Somewhat Disagree fw Strongly Disagree 
&] Agree Neither Agree nor Disagree i Disagree 


Note. n = 432. 


Now we turn to questions that we asked Survey 3 participants regarding the frequency 
of thoughts and engagement in ethics-related activities before and since they participated in 
the ProEthica program. Their responses are shown in Figure 11. The majority of respondents 
reported the same frequency for all activities since program participation (shown in the 
diagonal of each plot). The circles above the diagonals show respondents who reported an 
increase in frequency after ProEthica. Around 20%—-25% reported a higher frequency after 
program participation, and there was some variability across items. Only a trivial percentage of 


respondents reported a decrease in frequency after ProEthica. 
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Figure 11. Retrospective Reporting of Frequency of Thoughts and Engagement in Ethics- 


Related Activities Before and After ProEthica 


| had formal opportunities to discuss 
issues related to ethics training 
(n = 427). 
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| think about school policies as | 
make my daily decisions. (n = 426) 


| talk to an administrator about a 
professional issue involving ethical 
decision-making (n = 426). 


| think about how my actions might 
be perceived by students. (n = 424) 
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| think about talking to a colleague when 
faced with a professional issue involving 
ethical decision-making. (n = 424) 


25 | 


| talk to another educator about a 
professional issue involving ethical 
decision-making. (n = 427) 
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misunderstood by others. (n = 421) 
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Discussion 

This report describes the research design and survey results of a study focused on 
measuring the intended intermediate learning outcomes of the ProEthica program. We 
described the responses from teachers in a pilot school district who were asked about their 
perceptions of and experiences with professional ethics, generally and via the ProEthica 
program. Referring to the logic model in Figure 1, we collected evidence about the intended 
intermediate outcomes of the program from teachers who completed the modules and 
responded to our surveys. The main takeaways are that the majority of teachers who 
responded to the survey expressed a need for professional ethics and perceived both an 
increase in thoughtfulness regarding their ethical responsibilities and also a better 
understanding of principles of professional ethics for educators after participating in the 
ProEthica program. 

The general challenges we encountered in carrying out a study that could isolate the 
effects on learning outcomes of a professional development program on professional ethics for 
educators were due to constraints on resources and time as well as balancing coordination of 
onboarding the pilot district and implementing the research plan simultaneously. That is, we 
could not collect data from the entire population or a random subset because we did not have 
direct access to participants prior to the program. We were also limited in the number and 
types of questions we could ask participants within the online learning management system. 

Here we describe some specific challenges to our single-group pretest—posttest design. 
We were not able to adjust for nonresponse bias, and this is particularly relevant for Surveys 1 
and 3 with low response rates of 21% and 39%. There was suboptimal longitudinal overlap 
between participants responding to pairwise subsets of the three surveys, ranging from 115 
participants (Survey 1, Survey 3) to 258 participants (Survey 2, Survey 3) out of a total of 797 
unique participants. Only 69 participants completed all three surveys. Therefore, it is difficult to 
capture changes in perception that may have occurred over the course of the year or before 
and after participation in the ProEthica program. The current data also do not tell us why some 


participants did not respond to particular surveys. 
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Survey 2 included two prompts that we used to identify acquiescence response bias. 
The two prompts stated, “I gave my best effort to learning the ProEthica materials” and “1 
didn’t take using the ProEthica program very seriously.” When asked to indicate level of 
agreement with these prompts, we expected the results to tend to go in opposite directions. 
That is, we expected that participants who gave their best effort would be less likely to have 
not taken the program very seriously, and vice versa. We found evidence of this possible 
response bias in about 5% of participants’ responses; 27 participants reported that they 
strongly agreed that they put in their best effort but also strongly agreed that they did not take 
the program very seriously. This evidence could be a sign that those participants did not read 
the prompts carefully or did not respond to the survey with best effort. 

Our summary of responses in this report focuses on the multiple-choice items. We also 
read through the open-ended responses regarding participants’ perceptions about the impact 
and outcomes of the program. We recommend further exploration of these responses in future 
program research to inform revisions to modules and assessments. For example, some 
respondents indicated that the user experience may be improved through simplifying the 
vocabulary used in the modules, employing fewer acronyms, avoiding repetitiveness, and 
shortening the time required to engage with the modules. Motivational framing that highlights 
the benefits of the training may help to ameliorate the punitive aspects that some teachers felt 
(e.g., responding that they are now less likely to want to engage with students and parents for 
fear that they will end up in a bad ethical position). It may be useful to emphasize the 
importance of the training for more experienced teachers, especially given the previous 
suggestion and responses indicating that ethics are “common sense” that cannot be taught. 
Providing support materials (e.g., discussion guides) and working with schools or districts to 
embed the training in a larger professional development context may allow teachers to avoid 
having to do the training on their own time and would facilitate discussion between teachers 
and their peers and administrators. This would help to address both open-ended and multiple- 
choice responses about possible room for improvement in making discussions about ethics a 


more collaborative and comfortable part of teachers’ professional routines. 
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Table A1. Data in Figure 3 


Teachers’ Perceptions of ProEthica® Program Learning Outcomes 


Appendix 


Type of ethics Level of familiarity Percentage 
State code of ethics | am an expert. 9% 
State code of ethics lam familiar with them. 29% 
State code of ethics | have been introduced to and have 42% 
partial knowledge of them. 
State code of ethics | have not heard about nor received 20% 
training on them. 
Professional ethics for | am an expert. 4% 
educators 
Professional ethics for 1am familiar with them. 55% 
educators 
Professional ethics for | have been introduced to and have 30% 
educators partial knowledge of them. 
Professional ethics for | have not heard about nor received 11% 


educators 


training on them. 
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Table A2. Data in Figure 4 


Survey 1 completion Level of familiarity of professional ethics for 
status educators Frequency 

Did not complete Survey 1 ‘| had no prior knowledge of professional ethics for 3% 
educators. 

Did not complete Survey 1 ‘| had some knowledge of professional ethics for 23% 
educators. 

Did not complete Survey 1 ___| was familiar with professional ethics for 70% 
educators. 

Did not complete Survey 1 __| was already an expert in professional ethics for 5% 
educators. 

Completed Survey 1 | had no prior knowledge of professional ethics for 2% 
educators. 

Completed Survey 1 | had some knowledge of professional ethics for 37% 
educators. 

Completed Survey 1 | was familiar with professional ethics for 58% 
educators. 

Completed Survey 1 | was already an expert in professional ethics for 3% 
educators. 


ETS RM-20-09 24 


H. Buzick et al. 


Table A3. Data in Figure 5 


Teachers’ Perceptions of ProEthica® Program Learning Outcomes 


Survey item Level of agreement Percentage 

lam more thoughtful about my actions with Strongly disagree 2% 
students. 

lam more thoughtful about my actions with Disagree 1% 
students. 

1am more thoughtful about my actions with Somewhat disagree 0% 
students. 

| am more thoughtful about my actions with Neither agree nor 6% 
students. disagree 

lam more thoughtful about my actions with Somewhat agree 11% 
students. 

lam more thoughtful about my actions with Agree 47% 
students. 

1am more thoughtful about my actions with Strongly agree 34% 
students. 

lam more thoughtful about potential Strongly disagree 2% 
consequences of my decisions regarding 
student-teacher relationships. 

| am more thoughtful about potential Disagree 1% 
consequences of my decisions regarding 
student-teacher relationships. 

lam more thoughtful about potential Somewhat disagree 1% 
consequences of my decisions regarding 
student-teacher relationships. 

| am more thoughtful about potential Neither agree nor 6% 
consequences of my decisions regarding disagree 
student-teacher relationships. 

| am more thoughtful about potential Somewhat agree 8% 


consequences of my decisions regarding 
student-teacher relationships. 
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Survey item Level of agreement Percentage 

| am more thoughtful about potential Agree 46% 
consequences of my decisions regarding 
student-teacher relationships. 

lam more thoughtful about potential Strongly agree 37% 
consequences of my decisions regarding 
student-teacher relationships. 

1am more thoughtful about how | interact with Strongly disagree 2% 
colleagues. 

| am more thoughtful about how | interact with Disagree 1% 
colleagues. 

lam more thoughtful about how | interact with Somewhat disagree 0% 
colleagues. 

| am more thoughtful about how | interact with Neither agree nor 5% 
colleagues. disagree 

1am more thoughtful about how | interact with Somewhat agree 10% 
colleagues. 

| am more thoughtful about how | interact with Agree 49% 
colleagues. 

lam more thoughtful about how | interact with Strongly agree 32% 
colleagues. 

lam more thoughtful about my choices when Strongly disagree 2% 
using social media and digital technology 

| am more thoughtful about my choices when Disagree 1% 
using social media and digital technology 

lam more thoughtful about my choices when Somewhat disagree 0% 


using social media and digital technology 
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Survey item Level of agreement Percentage 

| am more thoughtful about my choices when Neither agree nor 5% 
using social media and digital technology disagree 

lam more thoughtful about my choices when Somewhat agree 9% 
using social media and digital technology 

lam more thoughtful about my choices when Agree 43% 
using social media and digital technology 

| am more thoughtful about my choices when Strongly agree 39% 
using social media and digital technology 

After completing the modules, | have a better Strongly disagree 1% 
understanding of the principles of professional 
ethics for educators. 

After completing the modules, | have a better Disagree 0% 
understanding of the principles of professional 
ethics for educators. 

After completing the modules, | have a better Somewhat disagree 2% 
understanding of the principles of professional 
ethics for educators. 

After completing the modules, | have a better Neither agree nor 4% 
understanding of the principles of professional disagree 
ethics for educators. 

After completing the modules, | have a better Somewhat agree 10% 
understanding of the principles of professional 
ethics for educators. 

After completing the modules, | have a better Agree 48% 
understanding of the principles of professional 
ethics for educators. 

After completing the modules, | have a better Strongly agree 34% 
understanding of the principles of professional 
ethics for educators. 

The ProEthica program has caused me to think Strongly disagree 0% 


differently about managing risks while 


interacting with people in my school community. 
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Survey item Level of agreement Percentage 

The ProEthica program has caused me to think Disagree 1% 
differently about managing risks while 
interacting with people in my school community. 

The ProEthica program has caused me to think Somewhat disagree 2% 
differently about managing risks while 
interacting with people in my school community. 

The ProEthica program has caused me to think Neither agree nor 8% 
differently about managing risks while disagree 
interacting with people in my school community. 

The ProEthica program has caused me to think Somewhat agree 15% 
differently about managing risks while 
interacting with people in my school community. 

The ProEthica program has caused me to think Agree 44% 
differently about managing risks while 
interacting with people in my school community. 

The ProEthica program has caused me to think Strongly agree 30% 
differently about managing risks while 
interacting with people in my school community. 

| feel more comfortable talking with my colleagues Strongly disagree 1% 
about professional ethics. 

| feel more comfortable talking with my colleagues Disagree 1% 
about professional ethics. 

| feel more comfortable talking with my colleagues | Somewhat disagree 2% 
about professional ethics. 

| feel more comfortable talking with my colleagues Neither agree nor 11% 
about professional ethics. disagree 

| feel more comfortable talking with my colleagues | Somewhat agree 14% 
about professional ethics. 

| feel more comfortable talking with my colleagues Agree 47% 
about professional ethics. 

| feel more comfortable talking with my colleagues Strongly agree 24% 
about professional ethics. 

| feel that more time should be devoted to Strongly disagree 1% 


discussing important issues related to educator 
ethics within my school community. 
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Survey item Level of agreement Percentage 
| feel that more time should be devoted to Disagree 2% 
discussing important issues related to educator 
ethics within my school community. 


| feel that more time should be devoted to Somewhat disagree 4% 
discussing important issues related to educator 
ethics within my school community. 


| feel that more time should be devoted to Neither agree nor 19% 
discussing important issues related to educator disagree 
ethics within my school community. 


| feel that more time should be devoted to Somewhat agree 24% 
discussing important issues related to educator 
ethics within my school community. 


| feel that more time should be devoted to Agree 31% 
discussing important issues related to educator 
ethics within my school community. 


| feel that more time should be devoted to Strongly agree 18% 
discussing important issues related to educator 
ethics within my school community. 


Table A4. Data in Figure 6 


How long since Survey 3 respondents completed 


the ProEthica program Percentage 
About 1-3 months ago 49% 
About 1-4 weeks ago 12% 
About 3-6 months ago 23% 
More than 6 months ago 14% 
Within the past week 1% 
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Table A5. Data in Figure 7 


Teachers’ Perceptions of ProEthica® Program Learning Outcomes 


Survey item Level of agreement Percentage 

| think it is important to have a set of professional Agree 35% 
ethics guidelines to inform professional decision- 
making. 

| think it is important to have a set of professional Disagree 0% 
ethics guidelines to inform professional decision- 
making. 

| think it is important to have a set of professional Neither agree nor 1% 
ethics guidelines to inform professional decision- disagree 
making. 

| think it is important to have a set of professional Somewhat agree 3% 
ethics guidelines to inform professional decision- 
making. 

| think it is important to have a set of professional Somewhat disagree 0% 
ethics guidelines to inform professional decision- 
making. 

| think it is important to have a set of professional Strongly agree 57% 
ethics guidelines to inform professional decision- 
making. 

| think it is important to have a set of professional Strongly disagree 3% 
ethics guidelines to inform professional decision- 
making. 

| think that professional ethics should be included as Agree 40% 
part of formal training. 

| think that professional ethics should be included as Disagree 1% 
part of formal training. 

| think that professional ethics should be included as Neither agree nor 4% 
part of formal training. disagree 

| think that professional ethics should be included as © Somewhat agree 13% 
part of formal training. 

| think that professional ethics should be included as © Somewhat disagree 1% 
part of formal training. 

| think that professional ethics should be included as Strongly agree 38% 
part of formal training. 

| think that professional ethics should be included as _— Strongly disagree 2% 


part of formal training. 
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Survey item Level of agreement Percentage 

| think that formal training in educator ethics should Agree 39% 
be required for employment in a school. 

| think that formal training in educator ethics should Disagree 2% 
be required for employment in a school. 

| think that formal training in educator ethics should Neither agree nor 5% 
be required for employment in a school. disagree 

| think that formal training in educator ethics should © Somewhat agree 14% 
be required for employment in a school. 

| think that formal training in educator ethics should © Somewhat disagree 2% 
be required for employment in a school. 

| think that formal training in educator ethics should Strongly agree 37% 
be required for employment in a school. 

| think that formal training in educator ethics should = Strongly disagree 1% 
be required for employment in a school. 

| think that my school community needs to improve Agree 20% 
its culture and awareness of issues that involve 
ethical decision-making. 

| think that my school community needs to improve Disagree 11% 
its culture and awareness of issues that involve 
ethical decision-making. 

| think that my school community needs to improve Neither agree nor 23% 
its culture and awareness of issues that involve disagree 
ethical decision-making. 

| think that my school community needs to improve Somewhat agree 23% 
its culture and awareness of issues that involve 
ethical decision-making. 

| think that my school community needs to improve Somewhat disagree 4% 
its culture and awareness of issues that involve 
ethical decision-making. 

| think that my school community needs to improve Strongly agree 15% 
its culture and awareness of issues that involve 
ethical decision-making. 

| think that my school community needs to improve Strongly disagree 4% 


its culture and awareness of issues that involve 
ethical decision-making. 
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Survey item Level of agreement Percentage 

| think that participating in the ProEthica Program will Agree 25% 
contribute to improvement in the culture at my 
school. 

| think that participating in the ProEthica Program will Disagree 6% 
contribute to improvement in the culture at my 
school. 

| think that participating in the ProEthica Program will Neither agree nor 20% 
contribute to improvement in the culture at my disagree 
school. 

| think that participating in the ProEthica Program will Somewhat agree 28% 
contribute to improvement in the culture at my 
school. 

| think that participating in the ProEthica Program will Somewhat disagree 5% 
contribute to improvement in the culture at my 
school. 

| think that participating in the ProEthica Program will Strongly agree 11% 
contribute to improvement in the culture at my 
school. 

| think that participating in the ProEthica Program will Strongly disagree 5% 
contribute to improvement in the culture at my 
school. 

| feel that | am fully aware of the ethical issues Agree 47% 
affecting my daily professional decisions. 

| feel that | am fully aware of the ethical issues Disagree 0% 
affecting my daily professional decisions. 

| feel that | am fully aware of the ethical issues Neither agree nor 2% 
affecting my daily professional decisions. disagree 

| feel that | am fully aware of the ethical issues Somewhat agree 13% 
affecting my daily professional decisions. 

| feel that | am fully aware of the ethical issues Somewhat disagree 1% 
affecting my daily professional decisions. 

| feel that | am fully aware of the ethical issues Strongly agree 37% 
affecting my daily professional decisions. 

| feel that | am fully aware of the ethical issues Strongly disagree 1% 


affecting my daily professional decisions. 
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Table A6. Data in Figure 9 


Survey item Level of agreement Percentage 

Increase my knowledge of professional ethics for Agree 37% 
educators. 

Increase my knowledge of professional ethics for Disagree 4% 
educators. 

Increase my knowledge of professional ethics for Neither agree nor 12% 
educators. disagree 

Increase my knowledge of professional ethics for Somewhat agree 28% 
educators. 

Increase my knowledge of professional ethics for Somewhat disagree 3% 
educators. 

Increase my knowledge of professional ethics for Strongly agree 12% 
educators. 

Increase my knowledge of professional ethics for Strongly disagree 4% 
educators. 

Increase my awareness of professional risks and Agree 44% 
vulnerabilities. 

Increase my awareness of professional risks and Disagree 4% 
vulnerabilities. 

Increase my awareness of professional risks and Neither agree nor 9% 
vulnerabilities. disagree 

Increase my awareness of professional risks and Somewhat agree 22% 
vulnerabilities. 

Increase my awareness of professional risks and Somewhat disagree 2% 
vulnerabilities. 

Increase my awareness of professional risks and Strongly agree 16% 
vulnerabilities. 

Increase my awareness of professional risks and Strongly disagree 3% 
vulnerabilities. 

Build and communicate a shared understanding of Agree 43% 
professional ethics standards. 

Build and communicate a shared understanding of Disagree 4% 


professional ethics standards. 
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Survey item Level of agreement Percentage 

Build and communicate a shared understanding of Neither agree nor 15% 
professional ethics standards. disagree 

Build and communicate a shared understanding of Somewhat agree 21% 
professional ethics standards. 

Build and communicate a shared understanding of Somewhat disagree 3% 
professional ethics standards. 

Build and communicate a shared understanding of Strongly agree 12% 
professional ethics standards. 

Build and communicate a shared understanding of Strongly disagree 3% 
professional ethics standards. 

Make decisions grounded in professional ethics Agree 42% 
standards. 

Make decisions grounded in professional ethics Disagree 5% 
standards. 

Make decisions grounded in professional ethics Neither agree nor 14% 
standards. disagree 

Make decisions grounded in professional ethics Somewhat agree 19% 
standards. 

Make decisions grounded in professional ethics Somewhat disagree 4% 
standards. 

Make decisions grounded in professional ethics Strongly agree 13% 
standards. 

Make decisions grounded in professional ethics Strongly disagree 3% 
standards. 

Uphold my obligation to act in the public's interest Agree 43% 

Uphold my obligation to act in the public's interest Disagree 3% 

Uphold my obligation to act in the public's interest Neither agree nor 15% 

disagree 

Uphold my obligation to act in the public's interest Somewhat agree 16% 

Uphold my obligation to act in the public's interest Somewhat disagree 4% 

Uphold my obligation to act in the public's interest Strongly agree 16% 

Uphold my obligation to act in the public's interest Strongly disagree 3% 

Foster a sense of responsibility to hold myself and Agree 45% 


others to professional ethics standards. 
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Survey item Level of agreement Percentage 

Foster a sense of responsibility to hold myself and Disagree 3% 
others to professional ethics standards. 

Foster a sense of responsibility to hold myself and Neither agree nor 11% 
others to professional ethics standards. disagree 

Foster a sense of responsibility to hold myself and Somewhat agree 18% 
others to professional ethics standards. 

Foster a sense of responsibility to hold myself and Somewhat disagree 4% 
others to professional ethics standards. 

Foster a sense of responsibility to hold myself and Strongly agree 16% 
others to professional ethics standards. 

Foster a sense of responsibility to hold myself and Strongly disagree 4% 
others to professional ethics standards. 

Collaborate to discuss professional ethics within a Agree 38% 
supportive school climate. 

Collaborate to discuss professional ethics within a Disagree 6% 
supportive school climate. 

Collaborate to discuss professional ethics within a Neither agree nor 16% 
supportive school climate. disagree 

Collaborate to discuss professional ethics within a Somewhat agree 22% 
supportive school climate. 

Collaborate to discuss professional ethics within a Somewhat disagree 3% 
supportive school climate. 

Collaborate to discuss professional ethics within a Strongly agree 10% 
supportive school climate. 

Collaborate to discuss professional ethics within a Strongly disagree 5% 


supportive school climate. 
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Table A7. Data in Figure 10 


Teachers’ Perceptions of ProEthica® Program Learning Outcomes 


Survey item Level of agreement Percentage 

| think more about the Model Code of Ethics for Agree 27% 
Educators (MCEE) when interacting with my 
colleagues. 

| think more about the Model Code of Ethics for Disagree 7% 
Educators (MCEE) when interacting with my 
colleagues. 

| think more about the Model Code of Ethics for Neither agree nor 25% 
Educators (MCEE) when interacting with my disagree 
colleagues. 

| think more about the Model Code of Ethics for Somewhat agree 27% 
Educators (MCEE) when interacting with my 
colleagues. 

| think more about the Model Code of Ethics for Somewhat disagree 5% 
Educators (MCEE) when interacting with my 
colleagues. 

| think more about the Model Code of Ethics for Strongly agree 6% 
Educators (MCEE) when interacting with my 
colleagues. 

| think more about the Model Code of Ethics for Strongly disagree 4% 
Educators (MCEE) when interacting with my 
colleagues. 

| think more about the Model Code of Ethics for Agree 32% 
Educators (MCEE) when interacting with students. 

| think more about the Model Code of Ethics for Disagree 6% 
Educators (MCEE) when interacting with students. 

| think more about the Model Code of Ethics for Neither agree nor 19% 
Educators (MCEE) when interacting with students. disagree 

| think more about the Model Code of Ethics for Somewhat agree 23% 
Educators (MCEE) when interacting with students. 

| think more about the Model Code of Ethics for Somewhat disagree 3% 
Educators (MCEE) when interacting with students. 

| think more about the Model Code of Ethics for Strongly agree 13% 
Educators (MCEE) when interacting with students. 

| think more about the Model Code of Ethics for Strongly disagree 4% 


Educators (MCEE) when interacting with students. 
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Survey item Level of agreement Percentage 

| feel more comfortable talking with my colleagues Agree 31% 
about issues that involve my own ethical decision- 
making. 

| feel more comfortable talking with my colleagues Disagree 5% 
about issues that involve my own ethical decision- 
making. 

| feel more comfortable talking with my colleagues Neither agree nor 27% 
about issues that involve my own ethical decision- disagree 
making. 

| feel more comfortable talking with my colleagues Somewhat agree 23% 
about issues that involve my own ethical decision- 
making. 

| feel more comfortable talking with my colleagues Somewhat disagree 3% 
about issues that involve my own ethical decision- 
making. 

| feel more comfortable talking with my colleagues Strongly agree 8% 
about issues that involve my own ethical decision- 
making. 

| feel more comfortable talking with my colleagues Strongly disagree 3% 
about issues that involve my own ethical decision- 
making. 

| feel more comfortable talking to my colleagues about Agree 26% 
issues that involve their ethical decision-making. 

| feel more comfortable talking to my colleagues about Disagree 6% 
issues that involve their ethical decision-making. 

| feel more comfortable talking to my colleagues about Neither agree nor 28% 
issues that involve their ethical decision-making. disagree 

| feel more comfortable talking to my colleagues about Somewhat agree 23% 
issues that involve their ethical decision-making. 

| feel more comfortable talking to my colleagues about Somewhat disagree 6% 
issues that involve their ethical decision-making. 

| feel more comfortable talking to my colleagues about Strongly agree 6% 
issues that involve their ethical decision-making. 

| feel more comfortable talking to my colleagues about Strongly disagree 3% 


issues that involve their ethical decision-making. 
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Survey item 


Level of agreement 


Percentage 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my own ethical decision- 
making. 


| feel more comfortable talking with my administrators 
about issues that involve my colleagues’ ethical 
decision-making. 


| feel more comfortable talking with my administrators 
about issues that involve my colleagues’ ethical 
decision-making. 


| feel more comfortable talking with my administrators 
about issues that involve my colleagues’ ethical 
decision-making. 


| feel more comfortable talking with my administrators 
about issues that involve my colleagues’ ethical 
decision-making. 


| feel more comfortable talking with my administrators 
about issues that involve my colleagues’ ethical 
decision-making. 


Agree 


Disagree 


Neither agree nor 


disagree 


Somewhat agree 


Somewhat disagree 


Strongly agree 


Strongly Disagree 


Agree 


Disagree 


Neither agree nor 


disagree 


Somewhat agree 


Somewhat disagree 


32% 


6% 


27% 


21% 


3% 


8% 


3% 


28% 


6% 


28% 


22% 


6% 
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Survey item Level of agreement Percentage 

| feel more comfortable talking with my administrators Strongly agree 6% 
about issues that involve my colleagues’ ethical 
decision-making. 

| feel more comfortable talking with my administrators Strongly disagree 4% 
about issues that involve my colleagues’ ethical 
decision-making. 

| feel that | am more aware of potential ethical related Agree 35% 
issues that | may have overlooked before. 

| feel that | am more aware of potential ethical related Disagree 4% 
issues that | may have overlooked before. 

| feel that |am more aware of potential ethical related Neither agree nor 16% 
issues that | may have overlooked before. disagree 

| feel that | am more aware of potential ethical related Somewhat agree 26% 
issues that | may have overlooked before. 

| feel that | am more aware of potential ethical related Somewhat disagree 3% 
issues that | may have overlooked before. 

| feel that | am more aware of potential ethical related Strongly agree 13% 
issues that | may have overlooked before. 

| feel that | am more aware of potential ethical related Strongly disagree 3% 
issues that | may have overlooked before. 

| am better about making the best decision with the Agree 38% 
least amount of risk. 

| am better about making the best decision with the Disagree 5% 
least amount of risk. 

| am better about making the best decision with the Neither agree nor 20% 
least amount of risk. disagree 

| am better about making the best decision with the Somewhat agree 22% 
least amount of risk. 

| am better about making the best decision with the Somewhat disagree 2% 
least amount of risk. 

| am better about making the best decision with the Strongly agree 10% 
least amount of risk. 

| am better about making the best decision with the Strongly disagree 3% 


least amount of risk. 
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Survey item Level of agreement Percentage 

lam more thoughtful about my choices when using Agree 38% 
social media and digital technology. 

lam more thoughtful about my choices when using Disagree 3% 
social media and digital technology. 

| am more thoughtful about my choices when using Neither agree nor 18% 
social media and digital technology. disagree 

| am more thoughtful about my choices when using Somewhat agree 18% 
social media and digital technology. 

| am more thoughtful about my choices when using Somewhat disagree 1% 
social media and digital technology. 

| am more thoughtful about my choices when using Strongly agree 17% 
social media and digital technology. 

| am more thoughtful about my choices when using Strongly disagree 4% 
social media and digital technology. 

| have more confidence in my ability to imagine Agree 39% 
various outcomes to an ethical scenario. 

| have more confidence in my ability to imagine Disagree 5% 
various outcomes to an ethical scenario. 

| have more confidence in my ability to imagine Neither agree nor 17% 
various outcomes to an ethical scenario. disagree 

| have more confidence in my ability to imagine Somewhat agree 24% 
various outcomes to an ethical scenario. 

| have more confidence in my ability to imagine Somewhat disagree 1% 
various outcomes to an ethical scenario. 

| have more confidence in my ability to imagine Strongly agree 11% 
various outcomes to an ethical scenario. 

| have more confidence in my ability to imagine Strongly disagree 3% 
various outcomes to an ethical scenario. 

| feel more certain of when to ‘act' versus when to'let Agree 36% 
something go' when confronted with a potential 
ethical scenario. 

| feel more certain of when to ‘act' versus when to 'let Disagree 4% 


something go' when confronted with a potential 
ethical scenario. 
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Survey item Level of agreement Percentage 

| feel more certain of when to ‘act' versus when to'let Neither agree nor 22% 
something go' when confronted with a potential disagree 
ethical scenario. 

| feel more certain of when to ‘act' versus when to ‘let Somewhat agree 22% 
something go' when confronted with a potential 
ethical scenario. 

| feel more certain of when to ‘act' versus when to ‘let Somewhat disagree 3% 
something go' when confronted with a potential 
ethical scenario. 

| feel more certain of when to ‘act' versus when to ‘let Strongly agree 10% 
something go' when confronted with a potential 
ethical scenario. 

| feel more certain of when to ‘act' versus when to 'let Strongly disagree 3% 
something go' when confronted with a potential 
ethical scenario. 

| feel that participating in the ProEthica training was Agree 33% 
worth the effort. 

| feel that participating in the ProEthica training was Disagree 7% 
worth the effort. 

| feel that participating in the ProEthica training was Neither agree nor 15% 
worth the effort. disagree 

| feel that participating in the ProEthica training was Somewhat agree 22% 
worth the effort. 

| feel that participating in the ProEthica training was Somewhat disagree 4% 
worth the effort. 

| feel that participating in the ProEthica training was Strongly agree 12% 
worth the effort. 

| feel that participating in the ProEthica training was Strongly disagree 7% 


worth the effort. 
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Notes 


1 https://www.ets.org/proethica/complete/modules 
* http://www.nea.org/home/30442.htm 
3 https://methods.sagepub.com/reference/encyclopedia-of-survey-research-methods/n3.xml 
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